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ABSTRACT 

We critically review the current null results on a varying fine-structure constant, a, derived 
from VLT/UVES quasar absor ption spectra, focu sing primarily on the many-multiplet analy- 
sis of 23 absorbers from which IChand et al] d2004l) reported a weighted mean relative varia- 
tion of Aa/a = (-0.06 ± 0.06) x 10~ 5 . Our analysis of the same reduced data, using the same 
fits to the absorption profiles, yields very different individual Aa/a values with uncertainties 
typically larger by a factor of ~3. We attribute the discrepancies to flawed parameter estima- 
tion techniques in the original analysis and demonstrate that the original Aa/a values were 
strongly biased towards zero. Were those flaws not present, the input data and spectra should 
have given a weighted mean of Aa/a = (-0.44 + 0.16) x 10~ 5 . Although this new value does 
reflect the input spectra and fits (unchanged from the original work - only our analysis is dif- 
ferent), we do not claim that it supports previous Keck/HIRES evidence for a varying a: there 
remains significant scatter in the individual Aa/a values which may stem from the overly 
simplistic profile fits in the original work. Allowing for such additional, unknown random er- 
rors by increasing the uncertainties on Aa/a to match the scatter provides a more conservative 
weighted mean, Aa/a = (-0.64 + 0.36) x 10~ 5 . We highlight similar problems in other current 
UVES constraints on varying a and argue that comparison with previous Keck/HIRES results 
is premature. 
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1 INTRODUCTION 

Absorption lines from heavy element species in distant gas clouds 
along the sight-lines to background quasars (QSOs) are impor- 
tant probes of possible variations in the fine-structure constant, a, 
over cosmologic al time- and distance-scales. The ma ny-multiplet 
(MM) method jDzuba et alj|l999l : IWebb et alj|l999h utilizes the 
relative wavelength shifts expected from different transitions in 
different neutral and/or ionized metallic species to measure a 
with an order of magnitude better precision than previous tech- 
niques such as the alkali doublet (A D) method. It yielded the 
first tentative evidence for a- variation (Webb etalJll999h and sub- 
sequent, larger samples saw this evidence grow in significance 
and internal robustness |Murphv et alj l2001a: I Webb et al.ll200ll ; 
Murp hvTWebb & Flambaumll2003l hereafter |M03|) . MM analysis 
of 143 absorption spectra, all from the Keck/HIRES instrument, 
currently indicate a smaller a in the clouds at the fractional level 
Aa/a = ( -0.57 ± 0.11) x 1(T 5 over th e red shift range 0.2 < 
z abs < 4.2 jMurphv et afll2004l. hereafter ImpI) . Clearly, this po- 
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tentially fundamental result must be refuted or confirmed with 
many different spectrographs to guard against subtle systematic er - 
rors which, despite extensive searches I Mur phy et al.l20oTbllM03h . 
have evaded detection so far. 

First attempts at constraining a- variation with the Ultraviolet 
and Visual Echelle Spectrograph (UVES) on the Very Large Tele- 
scope (VLT) in Chile have, at first glance, yielded null results. The 
MM constraints in the literature are summarized by Fig.[T] the cap- 
tion of which describes several important caveats for interpreting 
the figure. 

To date, the only MM analysis of a stat istically si gnifi- 
cant UVES sample is that of IChand etall l2004 hereafter IcoH : 
ISrianand et alj2004l summarize the main results) who reported that 
Aa/a = (-0.06 ± 0.06) x 10~ 5 from 23 absorbers in the redshift 
range 0.4 < z abs < 2.3. The main aim of the current paper is to 
revise these results after demonstrating simple flaws in the data 
analysis technique of C04. The same flaws are also evident in the 
AD analysis of IChand et al.1 d2005h who reported a weighted mean 
Aa/a = (+0.15±0.43)x 10~ 5 from 15 Siiv doublets over the range 
1.5 <z iibs <3.0. 

Different MM analyses of 2 individual absorption clouds for 
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Figure 1. Summary of the many-multiplet constraints on Aa/a in the literature. The table shows the instrument used, the sample size (N a b 8 ), the absorption 
redshift (or range), the value of Aa/a with 1-cr error (for statistical samples, the weighted mean value and its 1-cr error are quoted) and the corresponding 
references. The plot allows easy comparison of the Aa/a values and their 1-cr errors but there are several important caveats the reader should note: (i) We 
demonstrate in this paper that some UVES and HARPS constraints are based on flawed parameter estimation techniques and are not reliable. The reliability 
of other UVES constraints is also questioned in this work; (ii) Many points are not independent. Points in the plot with the same symbols use the same data 
(to varying extents); (iii) The sample sizes are very different. Some samples contain only a single absorption system; random errors for statistical samples 
are systematic errors for single absorbers; (iv) The redshift ranges vary considerably. If a does vary from absorber to absorber then that information is lost 
here; (v) The typical signal-to-noise ratio of the spectra in each sample is different; (vi) Some error-ba rs on Aa/a contain a systematic component which is 
combined with the stati stical one into a single error term. Other points contain no systematic error term. lOuast et alj <2004) quote a separate systematic term. 
iLevshakov eTaT] (2006) do calculate a systematic term but do not quote it together with the statistical term. 



which higher signal-to-noise ratio (S/N) spectra are available have 
also provided seemingly strong constraints on Aa/a. Null results 
with 1-cr statisti cal uncertai n ties o f 0.19, 0.15 and 0.24 x 10 -5 
were derived by [ Quast et all d2004l) , ILevshakov et al. I J2005t) and 
IChand et al.1 d2006h . respectively, from UVES spectra of the com- 
plex z a bs = 1.151 ab s orber towards HE 05 15-4414. The con- 
straint of IChand et al.l ( |2006|) again suffers from the same data 
analys is errors a s the statistical results in |C04 ILevshakov et al.l 
hereafter |L06[) improved their ear lier constraints (from 
lOuast et al.ll2004l and lLevshakov et alj|2005h to Aa/a = (-0.007 ± 
0.084) x 10~ 5 . We demonstrate here that the UVES data utilized 
in that analysis simply do not allow such a low statistical uncer- 
tainty. The other individual high-S/N absorber analysed with the 
MM method is at z abs = 1.839 towar ds Q 1101-264. Recently, 
ILevshakov et alj d2007l. herea fter |L07|) revised their earlier con- 
straint dLevshakov et aljioblh from Aa/a = (0.20 ± 0.38) x 10" 5 to 
Aa/a = (0.54 ± 0.25) x 10~ 5 by analysing new spectra with higher 
resolution. We discuss this result further in Section|4] 

As mentioned above, the mai n foc us of this paper is to criti- 
cally analyse the reliability of the lC04l results, the only statistical 
MM study apart from our previous Keck/HIRES work. In Section 
[2]we point out problems in the '^ 2 -curve' measurement technique 
used by |C04l . We also introduce a simple algorithm for estimating 
the minimum statistical error in Aa/a achievable from any given 
absorption spectrum. The uncertainties quoted by |C04| are incon- 
sistent with this 'limiting precision'. In Section[3]we revise the lC04l 
results using the same spectral data but with robust numerical algo- 
rithm s which we demonstrate are immune to the errors evident in 
|C04 Section|4]discusses the other constraints on Aa/a from UVES 
mentioned above. We conclude in Section[5] 



2 MOTIVATIONS FOR REVISING UVES RESULTS 
2.1 x 1 curves 

Aa/a is typically measured in a quasar absorption system using a 
X 2 minimization analysis of multiple-component Voigt profiles si- 
multaneously fit to the absorption profiles of several different tran- 
sitions. The column densities, Doppler widths and redshifts defin- 
ing the individual components are varied iteratively until the de- 
crease in x 1 between it erations falls below a s pecifi ed tolerance, 
Axl v Our approach in iMurphv etal] J200lj) . Im03| & |M04| was 
simply to add Aa/a as an additional fitting parameter, to be var- 
ied simultaneously with a ll the other para meters in order to mini- 
mize^ 2 . The approach of lC04l following IWebb et alj dl999f ). was 
to keep Aa/a as an external parameter: for a fixed input value of 
Aa/a the other parameters of the fit are varied to minimize^ 2 . The 
input value of Aa/a is stepped along over a given range around 
zero and x 2 is computed at each step. The functional form of x 2 
implies that, in the vicinity of the best-fitting Aa/a, the 'x 2 curve' 
- the value of x 2 as a function of the input value of Aa/a - should 
be near parabolic and smooth. In practice, this means that in each 
separate fit, with a different input Aa/a, Ax 2 ol should be set to <sc 1 
to ensure that any fluctuations on the final x 2 curve are also <k 1 . 
This is obviously crucial when using the standard method of deriv- 
ing the 1-cr uncertainty, S(Aa/a), from the width of the^ 2 curve at 
/tmin + 1- if the fluctuations on the^ 2 curve are >1 then one expects 
X^ ltl to be rather poorly defined and S(Aa/a) to be underestimated. 
The larger the fluctuations on the x 2 curve, the more the measured 
value of Aa/a will deviate from the true value and, even worse, the 
more significantly it will deviate since its uncertainty will be more 
underestimated. 
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Even a cursory glance at the y 2 cur ves of |C04| - figure 2 in 
ISrianand et all | |2004|) . fi gure 14 in |C04| itself - reveal that none 
could be considered smooth at the <*c 1 level and, almost without 
exception, the x 2 fluctuations significantly exceed unity (two ex- 
amples are shown in Section [3~3l - see Fig. [5}. Again, we stress that 
no matter how noisy the spectral data or how poorly one's model 
profile fits the data or how many free parameters are being fittecQ, 
the x 2 curve should be smooth and near parabolic in the vicinity 
of the best fit. The x 2 fluctuations in lC04l must therefore be due to 
failings in the algorithm used to minimize,^ 2 for each input Aa/a. 
This point can not be over-emphasized since the^ 2 curve is the very 
means by which lC04l measure Aa/a and its uncertainty in each ab- 
sorption system. 

Based on fits to simulated absorption spectra. Ic04l argue that 
their measurement technique is indeed robust. However, strong 
fluctuations even appear in the^ 2 curves for these simulations (their 
figure 2). This leads to spurious Aa/a values: figure 6 in lC04l shows 
the results from 30 realizations of a simulated single-component 
Mg/Fen absorber. At least 15 Aa/a values deviate by > lcr from 
the input value; 8 of these deviate by > 2a and 4 by 3> 3<x. There 
is even a w 5-cr value. The distribution of Aa/a values should be 
Gaussian in this case but these outliers demonstrate that it obvi- 
ously is not. The x 2 fluctuations also cause the uncertainty esti- 
mates, S(Aa/a), from each simulation to range over a factor of a 4 
even though all realizations had the same simulated S/N and input 
parameters. None of these problems arise in our o wn simulations 
of ei ther single- or multiple-component systems dMurphvl |2002| ; 
lM03h . 

Clearly, the results of |C04| cannot be reliable if the^ 2 mini- 
mization algorithm - the means by which Aa/a and S(Aa/a) are 
measured - failed. From the discussion above, we should expect 
that their uncertainty estimates are underestimated as a result. The 
following sub-section demonstrates this by introducing a simple 
measure of the minimum possible 5(Aa/a) in a given absorption 
system. We correct the analysis of C04 in Section[3]using the same 
data and profile fits. 



2.2 A simple measure of the limiting precision on Aa/a 
2.2.1 Formalism 

The velocity shift, Av,-, of transition i due to a small variation in a, 
i.e. Aa/a <K 1, is determined by the ^-coefficient for that transition, 



o>i(z) = w ; (0) + q t [(a z /a ) 2 - l] 



Av, 

c a tL>j(Q) 



2--^r, (1) 



where W;(0) and a>j(z) are the rest-frequencies in the laboratory and 
in an absorber at redshift z respectively. Similarly, ao and a, are the 
laboratory and absorber values of a. The MM method is the com- 
parison of measured velocity shifts from several transitions (with 
different ^-coefficients) to compute the best-fitting Aa/a. The lin- 
ear equation (TJ implies that the error in Aa/a is determined only 
by the distribution of ^-coefficients (assumed to have negligible er- 
rors) being used and the statistical errors in the velocity shifts, (5 V ,,-: 



8(Aa/a\i 
where 



(2) 



1 Of course, the number of parameters fitted must be less than the number 
of spectral pixels. 
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This expression is just the solution to a straight-line least-squares 
fit, y = a + bx, to data (xj,yj), with errors only on the yj, where the 
intercept a is also allowed to vary. Allowing the intercept to vary 
is important since it mimics the real situation in fitting absorption 
lines where the absorption redshift and Aa/a must be determined 
simultaneously. 

Equation {2} can only be used if one knows the statistical er- 
ror on the velocity shift measurement for each transition, d v i . This 
quantity is only well-defined in an absorption system with a single 
fitted velocity component or in a system with several velocity com- 
ponents which do not blend or overlap significantly with each other. 
However, the general case - and, observationally, by far the most 
common one - is that absorbers have many velocity components 
which, at the resolution of the spectrograph, are strongly blended 
together. For this general case we wish to define a 'total velocity 
uncertainty' for each transition integrated over the absorption pro- 
file (i.e. over all components), cr v ,, so that the substitution <5 Vjj = ir»,, 
in equation (0 provides some easily-interpreted information about 
5(Aa/a) hm . 

The quantity <r v- , is com monly used in radial- velocity searches 
for extra-solar planets, e.g. iBouchv et al.l (2001), but is not nor- 
mally useful in QSO absorption-line studies. Most metal-line QSO 
absorption profiles display a complicated velocity structure and one 
usually focuses on the properties of individual velocity compo- 
nents, each of which is typically modelled by a Voigt profile. How- 
ever, it is important to realize that Aa/a and its uncertainty are inte- 
grated quantities determined by the entire absorption profile. Some 
velocity components - typically the narrow, deep-but-unsaturated, 
isolated ones - will obviously provide stronger constraints than oth- 
ers but all components nevertheless contribute something. Thus, 
<t v , should incorporate all the velocity-centroiding information 
available from a given profile shape. From a spectrum F(k) with 
1-cr error array a F {k), the minim um possible velocity uncertainty 
contributed by pixel k is given by dBouchv et alj200lf) 



O-y(k) 



cr F (k) 



A(k) [dF(k)/dA(k)] 



(5) 



That is, a more precise velocity measurement is available from 
those pixels where the flux has a large gradient and/or a small un- 
certainty. This quantity can be used as an optimal weight, W(k) = 
[cr v (k)/cy 2 , to derive the total velocity precision available from all 
pixels in a portion of spectrum, 



e[Z* W(k)Y 



(6) 



For each transition in an absorber, <r v , is calculated from equa- 
tions $5$ & l|6j. Note that the only requirements are the 1-<t error 
spectrum and the multi-component Voigt profile fit to the transi- 
tion's absorption profile. The latter allows the derivative in (O to be 
calculated without the influence of noise. If very high S/N spectra 
are available - i.e. where the cr F (k) are always much less than the 
flux difference between neighbouring pixels in high-gradient por- 
tions of the absorption profiles - then one could use the spectrum 
itself instead of the Voigt profile fit, thus making the estimate of 
cr v model-independent. Once <r v , has been calculated for all tran- 
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Figure 2. Left-hand panel: Simulation of two transitions in a multi-component absorber. Both transitions have the same velocity structure: two main spectral 
features, each comprising two blended velocity components with equal column densities. Labelled are distinct stages of differential saturation in the two 
main spectral features. Right-hand panel: The difference between the limiting precision, S(Aa/a)y Im , and the actual precision (as derived by x 1 -minimization 
analysis) varies strongly from stage to stage. In a single-component absorber the actual uncertainty tracks d'(Ao7a)|j m , as expected. See text for discussion. 



sitions (', the uncertainty in Aa/a simply follows from equation l[2j 
with the substitution 6 v j = <r v ,. 

2.2.2 Limiting precision 

It is important to realize that the uncertainty calculated with the 
above method represents the absolute minimum possible 1-cr er- 
ror on Aa/a; the real error - as derived from a simultaneous x 2 - 
minimization of all parameters comprising the Voigt profile fits to 
all transitions - will always be larger than 6(Aa/a)n m from equa- 
tion The main reason for this is that absorption systems usu- 
ally have several velocity components which have different optical 
depths in different transitions. Equation ([2j assumes that the ve- 
locity information integrated over all components in one transition 
can be combined with the same integrated quantity from another 
transition to yield an uncertainty on Aa/a. However, in a real de- 
termination of Aa/a, each velocity component (or group of com- 
ponents which define a sharp spectral feature) in one transition is, 
effectively, compared with only the same component (or group) in 
another transition. 

Figure [2] illustrates this important point. It shows simulated 
absorption profiles for two transitions commonly used in MM anal- 
yses (Mg ii /12796 and Fe n /12600) in different stages of saturation. 
The velocity structure is identical for both transitions and contains 
two well-separated main spectral features (MSFs), each of which 
comprises two velocity components which are blended together. 
The column-density ratios between the corresponding components 
of the two transitions is kept fixed while the total column density is 
varied. For each simulation with a different total column density we 
determined S(Aa/a) lim using the method above and the real value 
of 6(Aa/a) using the usual \ 2 minimization analysis. When com- 
paring 8{Aa/a\ m with 6(Aa/a) one notices 4 characteristic stages 
as the column density increases: 

• Stage 1: Both MSFs are relatively unsaturated in both transi- 
tions and so cr VJ will be small for /=Mgn A2196 and ;'=Fen /12600. 
Thus, 6(Aa/a)\i m is quite small. However, note that the right-hand 
MSF in Mgn A2196 is nevertheless a little saturated and so the 
real precision is somewhat weakened, i.e. S(Aa/a) is pushed higher 
than S(Aa/a)\ lm ; the high velocity precision available from that 
MSF in Fen /12600 is 'wasted' because the profile of the corre- 
sponding MSF in Mg n /12796 is smoother. 

• Stage 2: The right-hand MSF in Mgn ,12796 is now com- 



pletely saturated. Since that part of the profile is now smoother, 
6(Aa/a)\[ m should get larger. However, this is more than compen- 
sated by the additional centroiding potential (or velocity informa- 
tion) now offered by the weaker velocity components in the left- 
hand MSF and both MSFs in Fen /12600 due to the increased col- 
umn density. On the other hand, the real precision, S(Aa/a), has 
substantially worsened because the right-hand MSF from the two 
transitions no longer constrain Aa/a tightly when considered to- 
gether. This principle also applies to the left-hand MSF where, in 
Fe ii ,12600, it is too weak to provide strong constraints, even though 
the same velocity components in Mg n ,12796 are stronger and well- 
defined. 

• Stage 3: The decrease in 6(Aa/a)y lm is now dominated by the 
small increase in velocity information available from the left-hand 
MSF because the right-hand MSF of both transitions is now satu- 
rated. Note also that the real precision also improves here because 
the components of the left-hand MSF in Fen /12600 are getting 
stronger while the corresponding components of Mg n /12796 are 
not completely saturated. 

• Stage 4: The decrease in d(Aa/a)\ lm is now only marginal be- 
cause it is dominated only by one MSF in one transition, i.e. the 
left-hand side of Fen /12600. However, 6(Aa/a) has increased 
sharply because now even the left-hand MSF of Mg n ,12796 is sat- 
urated and, when considered together with the corresponding MSF 
of Fen /12600, provides no constraint on Aa/a. 

To summarize this illustration, it is always the case that 
6(Aa/a)]i m < 5(Aa/a) and it is the degree of differential satu- 
ration between corresponding components of different transitions 
which determines how much worse S(Aa/a) is than 6(Aa/a) llm . 
Also note that the S/N of the data (or the simulations above) af- 
fects <5(Aff/<z)ij m and 5{Aa/a) in precisely the same way. That is, 
the ratio S(Aa/a) lim /S(Aa/a) is independent of S/N. Only the de- 
gree of differential saturation between corresponding components 
of different transitions affects S(Aa/a) ]im /S(Aa/a). 

Finally, as the above discussion implies, fits comprising a sin- 
gle velocity component (or multiple but well separated compo- 
nents) should have 6(Aa/a) lim ss S(Aa/a). As an internal consis- 
tency check on our simulations, Fig. [2] also shows the results for 
an absorber with a single velocity component, again in the Mgn 
,12796 and Fe n ,12600 transitions. Note that 6(Aa/a\ m tracks quite 
closely the real value of 5(Aa/a) as a function of column density. 
Nevertheless, the real error is slightly worse than 5{Aa/a)\[ m \ this 



is expected because the real estimate derives from a fit where all 
parameters of the absorption profiles, including the Doppler param- 
eters and column densities, are varied simultaneously, thus slightly 
weakening the constraint on Aa/a (and the absorber redshift). 

2.2.3 Application to existing constraints on Aa/a 

We have calculated S(Aa/a)um f° r the absorbers from the three 
independent data-sets which constitute the strongest current con- 
straints on Aa/a: (i) the 143 absorbers in our Keck/HIRES sample 
(M04); (ii) the 23 absorption systems, comprising mostly Mg/Fen 
transitions, from UVES studied by|C04j; (iii) the UVES exposures 
of th e z abs = 1.151 absorber towards HE0515-4414 studied by 
lLOfj . Calculating d(Aa/a)u m requires only the error spectra and the 
Voigt profile models used to fit the data. For samples (ii) & (iii) we 
use the Voigt profile models published by those authors. Below we 
describe the errors arrays. For sample (ii), other aspects of the data 
are important for the analysis in Section[3]and so we also describe 
them here. 

The reduced (i.e. one-dimensional) spectra in sample (ii) were 
kindly provided to us by B. Aracil who confirmed that the wave- 
length and flux arrays are identical to those used in lC04l . However, 
one main difference is that the error ar rays w e use are generally a 
factor a; 1.4 smaller than those used by C04 (H. Chand, B. Aracil, 
2006, private communication). We have confirmed this by digitiz- 
ing the absorption profiles plotted in IC04l The reason for this is 
that they derive their error arrays by adding two error terms of sim- 
ilar magnitude in quadrature, even though each term should rea- 
sonably approximate the actual error. One term reflects the formal 
photon statistics while the other reflects the r.m.s. variation in the 
flux from the different exposures which are combined to form the 
final spectrum. Our error spectra were derived from the maximum 
of the two terms. Thus, the error spectra of |C04| are ~ 1.3-2 times 
larger than ours. We have confirmed that our error arrays match 
well the r.m.s. flux in unabsorbed spectral regions; they therefore 
more accurately reflect the real uncertainty in flux for each spec- 
tral pixel. Note that this implies that S(Aa/a)] im calculated using 
our spectra will be smaller than the value |C04| would deriv e. The 
only other difference between our spectra and those of C04 is that 
we performed our own continuum normalization of the absorption 
profiles. However, we used a method similar to that employed by 
|C04| and any small differences will have negligible effects on the 
analysis here and in Sectional. 

For sample (iii), we reduced the raw UVES exposures using 
a modified version of the UVES pipeline. For the present analy- 
sis, small differences between our reduction and that of lLOfj are 
unimportant; all that is required is that the error arrays matc h fair ly 
closely. Indeed, the S /N matches very well those quoted bvlLOrj in 
the relevant portions of the reduced spectrum. 

For all samples, the atomic data for the transitions (including 
^-coefficients) were the same as used by the original authors. 

In practice, when applying equations lO and ® we sub-divide 
the absorption profile of each transition into 15kms~' chunks to 
mitigate the effects illustrated in Fig. [2] This provides a value of 
S(Aa/a) lim j for each chunk j. The final value of 6(Aa/a) lim is sim- 
ply l/[6(Aa/a) tim j] 2 } 112 ; in all cases this is < 1.4 times the value 
obtained without sub-divisions. 

Figure[3]shows the 1-cr error on Aa/a quoted by the original 

2 This was checked by simply fitting different continua to some spectra and 
observing the effect on the best-fitting Aa/a for the absorbers involved. 
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Figure 3. Quoted errors o n Aa/a versus the l imiti ng precision, 5(Aa/a)\\ m , 
for current samples. The IChand et al l j2004l) and iLevshakov et alj feOOd) 
samples fail the basic requirement that 6(Aa/a) must be greater than 
S(Aa/a) ]im . 

authors versus the limiting precision, S(Aa/a)\ lm . The main results 
are c lear. Firstly, the 1-tr errors quoted for the HIRES sample in 
|M04| always exceed 6(Aa/a) lim , as expected if the former ar e ro- 
bustly estimated. Secondly, for at least 1 1 of their 23 absorbers. lC04l 
quote errors which are smaller than S(Aa/a)\i m . Recall that since 
their error arrays are larger than ours, 1 1 out of 23 is a conservative 
estimate; if they were to calculate S(Aa/a)\ lm using their larger er- 
ror arrays then more points on Fig. [3] would shift to the right into 
the 'forbidden region' where 5{Aa/a) < d(Aa/a\ m . Finally, the 
very small error quoted by[ixjl for HE 0515-4414, 0.084 x 10~ 5 , 
disagrees significantly with the limiting precision of 0.14 x 10~ 5 . 
Thus, the (supposedly) strong current UVES constraints on Aa/a 
fail a basic consi sten cy t est w hich not only challenges the preci- 
sion reported bv lC04l and lLOfj but which must bring into question 
the robustness and validity of their analysis and final Aa/a values. 

As discussed in Section 12.11 underestimated err or ba rs on 
Aa/a are expected from the jagged^ 2 curves derived by |C04l Now 
we explore what effect the fluctuations had on the values of Aa/a 
themselves and their uncertainties by applying a robust x 1 mini- 
mization algorithm. 

3 CORRECTING THE ANALYSIS OF CHAND ET 
AL. (2004) 

3.1 Analysis method 

It is crucial to e mpha size from the beginning here that we use the 
same spectra as |C04| for the following analysis. To be precise, we 
use the same values of the flux with precisely the same wavelength 
scale, while Section [2.2.31 details why o ur err or arrays are some- 
what (~30per cent) smaller than those of lC04 Our aim is to estab- 
lish the results that would have been obtained from the data had the 
X 1 minimization algorithm used by |C04j not failed. For this reason 
we also fitted the same velocity structures to the data as lC04l That 
is, for each absorption system, the best-fitting Voigt profile parame- 
ters of C04 were treated as first guesses in our^ 2 minimization pro- 
cedure. This is necessary because the Voigt profile parameters they 
report are not truly the best fitting ones (because their x 2 minimiza- 
tion algorithm failed). Nevertheless, the 'qualitative' aspects of the 
fits - i.e. the number and approximate relative positions of the con- 
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Figure 4. Left: Our new results (filled circles) are inconsistent with those o f lChand et aljfe004l) (grey squares) even though the same reduced data and profile 
fits were used. The only difference is that our^ 2 minimization procedure is robust. The weighted mean Aa/a = (-0.44 ± 0.16) X 10~ 5 is consistent with our 
previous HIRES results but the scatter in the new results indicate remaining systematic errors in the data and fits. Right: To account for this additional scatter, 
we increase 1-cr errors by adding a constant amount in quadrature such that the final x 2 = 1 about the weighted mean. The most conservative weighted mean 
result therefore becomes Aa/a = (-0.64 ± 0.36) X 10" 5 . 



stituent velocity components - remained the same throughout our 
subsequent x 2 minimization; it is in this sense that we sta te above 
that our "velocity structures" are the same as those of lC04l Finally, 
the relationships between the Doppler widths of corresponding ve- 
locity components in different transitions were also the same as in 




The an alysis procedure was the same as that described in de- 
tail in lM03l The Voigt profile fitting and^ 2 minimization are car- 
ried out within vpfit, a non-linear least-squares program designed 
specifically for analysing quasar absorption spectrqj, modified to 
include a sin gle value of Aa /a as a free parameter for each absorp- 
tion system (Murphv 2002). The relative tolerance for halting the 
X 1 minimization was set to A^ 2 o| /^ 2 = 2 x 10~ 7 (i.e. small enough 
that, even for profile fits with thousands of degrees of freedom, Ax 2 
is still « 1). Ex tensive simulations h ave confirmed the reliability 
of this approach (Murphv 2002; M03). The atomic data for the dif- 
ferent transitions (i.e. laboratory w avelen gths, oscillator strengths 
etc.) were identical to those used bv lC04 

Since Aa/a is a free parameter, its value is determined di- 
rectly during the x 1 minimization of each absorber and its uncer- 
tainty, d(Aa/a), is derived from the appropriate diagonal term of 
the final covariance matrix. As mentioned above, our error spectra 
are s ignificantly smaller (though more appropriate) than those of 
|C04| and so the final x 1 P er degree of freedom in the fit, x 2 -, is typ- 
ically as 1.5-4 rather than ~1 as would be expected if the model fit 
was appropriate (see Section |3T4l for further discussion), vpfit there- 
fore increases d(Aa/a) by a factor of -y^ 2 and these are t he values 
we rep ort here. S imulations similar to those discussed in Murphy 
(2002) and M03 confirm that such a treatment yields very robust 
uncertainty estimates (see also Section [3~3l . 

3.2 Results 

The best-fitting values of Aa/a and the 1-cr uncertainties, 6(Aa/a), 
are compared with those of |C04| in Fig.[4[left). TableQ]provides the 

3 http://www.ast.cam.ac.uk/~rfc/vpfit.html. 



numerical results. Many of the Aa/a values are significantly differ- 
ent to those of IC04l typically deviating from zero by much larger 
amounts. Moreover, our uncertainty estimates are almost always 
larger, usually by a significant margin (even though, again, our er - 
ror spectra are consistently smaller than those employed by |C04b . 
The formal weighted mean over the 23 absorbers is 

Aa/a = (-0.44 ± 0. 16) x 10~ 5 . (7) 

At first glance, this indicates a significantly smaller a in the absorp- 
tion clouds compared to the laboratory value and agrees well with 
our previous results from HIRES. However, Fig.|4jleft) also reveals 
significant scatter in the results well beyond what is expected based 
on our estimates of 6(Aa/a): the value of x 2 about the weighted 
mean is 77.6 which, for 22 degrees of freedom, has a probability of 
just 4 x 10~ 8 of being larger. It is therefore unclear whether these 
new results support our previous HIRES results or not. Further evi- 
dence is provided in Section [3~3l tha t thes e results do indeed reflect 
the reduced data and profile fits of |C04| and that the discrepancy 
with their results is due to strong biases in both their Aa/a and 
S(Aa/a) values. Systematic errors likely to affect the spectra are 
also discussed. 

If we regard the large additional scatter in the new results as 
evidence of some additional random error then we can estimate its 
magnitude by adding a constant amount in quadrature to the cur- 
rent errors such that the final x 2 about the weighted mean becomes 
unity per degree of freedom. The additional random error required 
is 1 .5 1 x 10~ 5 . Figure|4jright) shows the new results with error bars 
which include the additional error term. Using these increased error 
bars, the weighted mean becomes 

Aa/a = (-0.64 ± 0.36) x 10~ 5 . (8) 

This value is the most conservative estimate of Aa/a given the re- 
duced data and profile fits of |C04| as inputs. A similar procedure 
for dealing with increased scatter (beyond that expected from the 
purely statistical e r ror bars) was followed in several pre vious works 
(Webb et al.|[r999l ; |M03|; iTzanavaris et al]|2005Ll2007l) . In Section 
13.41 we discuss the possible origin of the large additional scatter, 
concluding that the profile fits of C04 are probably too simplistic. 
Indeed, this would lead to an additional systematic error for each 
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Table 1. Comparison of results from Chand et al . 12004) and this paper. Columns 1 & 2 give the J2000 and B1950 quasar names; 
the quasar emission redshift s are g iven in column 3. Column 4 gives the redshifts of the absorption systems. Columns 5 & 6 give 
the values from Chand et al. |20Q4|) of Aa/a and^ 2 per degree of freedom,^ 2 , for the absorption profile fit. Columns 7 & 8 give the 
results of our attempt to reprod uce those values. Column 9 gives our estimate of the wavelength calibration errors derived using the 
method of lMurphv et alj<2007h . All uncertainty estimates are 1-<t. 





Quasar name 




Zabs 


Chand et al. (2004) 


This work 




(Aff/o-jThAr 


J2000 


B1950 






tXttjOt [1U J 


Xv 


Aa/a [Kr 5 ] 


xl 


[lCr 5 ] 


ynnni a a 




HE 0001 -2340 


2.280 


0.4524 


0.2 ± 0.5 


1.10 


-0.963 ± 0.747 


3.27 


-0.260 ± 0.093 


J000J44- 


-232355 


HE 0001-2340 


2.280 


2.1854 


0.2 ±0.3 


1.15 


3.926 ±2.431 


2.16 


0.145 ±0.099 


J 000344- 


-2J23JJ 


HE 0001-2340 


2.280 


2.1872 


-0.2 ± 0.2 


1.20 


-0.122 ±0.774 


2.10 


-0.089 ± 0.099 


TOOfl/1 A Q 

J00044O- 


-415728 


Q 0002-422 


2.760 


1.5419 


0.0 ± 0.2 


0.66 


-4.655 ± 0.988 


1.00 


-0.090 ±0.103 


J000448- 


-415728 


Q 0002-422 


2.760 


2.1679 


0.0 ± 0.4 


1.03 


0.115 ±0.731 


0.78 


-0.102 ±0.069 


J000448- 


-415728 


Q 0002-422 


2.760 


2.3006 


-0.4 ± 0.4 


0.99 


-0.075 ± 1.001 


2.54 


-0.066 ± 0.086 


J011143- 


-350300 


Q0109-3518 


2.410 


1.1827 


0.0 ±0.8 


0.98 


0.249 ± 0.764 


1.70 


0.011 ±0.107 


J011143- 


-350300 


Q0109-3518 


2 410 


1 3489 


-0.6 ± 0.4 


1.08 


—2 724 + 1 144 


2 28 


n oqi +n osi 


J012417- 


-374423 


Q 0122-380 


2.189 


0.8221 


0.0 ± 0.9 


0.87 


1.062 ±0.859 


2.27 


-0.088 ± 0.078 


J012417- 


-374423 


Q 0122-380 


2.189 


0.8593 


-0.3 ± 0.2 


1.29 


-4.803 ± 0.941 


2.81 


0.027 ± 0.078 


J012417- 


-374423 


Q0122-380 


2.189 


1.2433 


-0.1 ±0.1 


0.89 


-2.447 ± 1.579 


4.10 


0.376 ± 0.095 


J024008- 


-230915 


PKS 0237-23 


2.223 


1.6359 


0.2 ± 0.7 


0.82 


-0.124 ±0.498 


2.00 


-0.062 ±0.105 


J024008- 


-230915 


PKS 0237-23 


2.223 


1.6372 


0.6 ± 0.6 


1.16 


1.539 ±0.939 


2.93 


0.054 ± 0.068 


J024008- 


-230915 


PKS 0237-23 


2.223 


1.6574 


0.3 ± 0.5 


0.92 


0.510 ±0.514 


2.29 


0.121 ±0.127 


J045523- 


-421617 


Q 0453-423 


2.660 


0.9084 


-0.4 ± 0.4 


1.82 


-1.507 ±0.549 


4.21 


-0.141 ±0.122 


J045523- 


-421617 


Q 0453-423 


2.660 


1.8584 


0.4 ± 0.4 


1.13 


0.315 ±0.712 


3.77 


0.467 ±0.118 


J134427- 


-103541 


HE 1341-1020 


2.134 


0.8728 


0.0 ± 0.2 


1.19 


-0.100 ±0.567 


2.49 


-0.065 ±0.071 


J134427- 


-103541 


HE 1341-1020 


2.134 


1.2767 


-0.1 ±0.2 


1.01 


0.524 ± 2.062 


4.30 


0.531 ±0.097 


J134427- 


-103541 


HE 1341-1020 


2.134 


1.9154 


0.8 ± 0.3 


1.49 


0.767 ± 0.627 


2.08 


0.058 ± 0.072 


J135038- 


-251216 


HE 1347-2457 


2.534 


1.4393 


0.0 ± 0.5 


1.10 


-1.272 ±0.767 


4.60 


0.024 ±0.1 14 


J212912- 


-153841 


PKS 2126- 158 


3.268 


2.0225 


-0.1 ±0.4 


1.19 


-2.725 ± 1.344 


2.65 


0.034 ±0.111 


J222006- 


-280323 


HE 2217-2818 


2.406 


0.9425 


-1.2 ±0.7 


0.90 


-1.453 ±0.852 


2.43 


-0.258 ±0.114 


J222006- 


-280323 


HE 2217-2818 


2.406 


1.5558 


0.2 ± 0.5 


1.22 


0.183 ±0.639 


2.93 


-0.112 ± 0.114 



absorption system which is random in sign and magnitude from ab- 
sorber to absorber. That is, the assumptions underlying the deriva- 
tion of equation l[8j above are fairly realistic. 



3.3 Biases in previous results 

Part of our motivation for revising the analysis o f lcol was the large 
fluctuations in their x 2 curves. Although we include Aa/a as a free 
parameter in our^ 2 minimization process, treating it as an external 
parameter instead (as in |C04|) is a simple matter. As discussed in 
Section |2"Tl a valid measurement of Aa/a and (especially) S(Aa/a) 
can only come from a smooth, near parabolic,^ 2 curve. The impor- 
tance of this point is obvious in Fig. [5] which shows our,^ 2 curves 
in two example absorbers. For all 23 absorbers, we recover smooth, 
near parabolic x 2 curves, the minima of which coincide well with 
the values of Aa/a plotted in Fig. [4] The two examples in Fig. [5] 
are no exceptions. Furthermore, the values of 5(Aa/a) recovered 
from the width of the x 2 curves near their minima agree with the 
values recovered from the covariance matrix analysis discussed in 
Section 13.11 Thus, it is clear that our x 2 minimization procedure 
returns robust values of Aa/a and S(Aa/a). 

In contrast, Fig. [5] also shows the^ 2 curves of lC04l digitized 
from their figure 14, for the two example absorbers. The large x 2 
fluctuations are obvious and it is clear that they cause two effects: 
(i) as already discussed, the 1-cr uncertainties, S(Aa/a), are under- 
estimated and (ii) the values of Aa/a themselves may be biased 
towards zero. 

The first effect is easy to understand: the minimum x 2 must, 
by definition, be found in a downward extreme fluctuation. Since 
the fluctuations are >1, the width of the 'curve' at^ 2 lin + 1 will be 



underestimated, typically by factors of order a few. The absorber 
at z abs = 1.2433 towards Q0122-380, shown in Fig.^left), is the 
extreme example of this problem. The^ 2 fluctuations are ~10 here, 
leading |C04| to assign an uncertainty of just S(Aa/a) = 0.1 x 10~ 5 
for this system. Note that different points on their x 2 curve are 
separated by this value so, even in principle, such an error esti- 
mate is questionable. Our robust error estimate is almost a factor 
of 16 times larger. Also note that it is far from clear how lC04l de- 
termine S(Aa/a) in some absorbers. One such case is shown in 
Fig. HJright) where, following the previous example, Aa/a would 
appe ar to be (-0.8 ± 0.1) x 10~ 5 rather than the value quoted by 
|C04 (-0.4 ± 0.4) x 10~ 5 . In a few absorbers, such as this one, the 
confusion inherent in deriving 5{Aa/a) from such jagged^ 2 curves 
may have somewhat ameliorated potentially gross underestimates; 
in others, not. 

The second effect - that the Aa/a values of |C04| are biased 
towards zero - is more difficult to understand. First, to demon- 
strate that the effect is significant, Fig.[6]shows the values of Aa/a 
from lC04l plotted with the 1-cr uncertainties from our analysis. The 
Aa/a values are clearly more tightly clustered around zero than 
expected based on our robust error-bars: the value of x 2 around the 
weighted mean of Aa/a = (0.04 + 0.16) x 10~ 5 is just 6.1. For 22 
degrees of freedom, a x 2 this low (or lower) has a probability of 
only Pyi = 3 x 10~ 4 of occurring by chance alone. The explana- 
tion for such a strong bias may be linked, again, to the failure of 
the^ 2 minimization algorithm of iC04 One possibility is that, for 
a given absorber, the minimization algorithm may have been run 
several times with Aa/a fixed to zero with very slightly different 
initial conditions (as one might do when experimenting with differ- 
ent velocity structures in the model fit), thus reducing x 2 to a rel- 



8 M.T. Murphy, J. K. Webb, V. V. Flambaum 



Q0122-380 z ab =1.2433 




250 320 



315 - 



- 200 



310 



- 150 



Q0453-423 z obg =0.9084 

i — i — i — | — i — i — i — i — | — i — i — i — i — | — i — i — i — i — | — i — r- r 

-•-This work -»-Chand et al. (2004) 




- 330 



- 320 



- 310 



-4 -2 2 -3 -2 -1 

Aa/a [lO" 5 ] Aa/a [10" 5 ] 

Figure 5. Example^ 2 curves from our minimization algorithm (black circles, left-hand vertical scales) compared with those o f lChandetalJi2004h (grey/blue 
triangles, right-hand vertical scales) which are simply reproduced from their figure 14. Fluctuations in the latter indicate failings in the minimization routine. 
Also note that sometimes (e.g. right-hand panel) the minima of lC04l 's curves are not well-defined due to these fluctuations. The points and error-bars at the 
minima indicate best-fitting values and l-cr uncertainties; for our curves they are from the algorithm where Aa/a is a free parameter. The vertical scales are 
normalized by the minimum value of^ 2 per degree of freedom (the CO^j values of^ 2 are reported in their table 3). Thu s, the two curves on each panel have 
the same value at their minima since this is simply the number of degrees of freedom, v, by construction. However, C04's curves rise much faster away from 
Aa/a = b ecause the minimization algorithm fails to find the true minimum^ 2 at each step in Aa/a. This may be the cause of the strong evident bias towards 
zero in C04's values of Aa/a (see Section l3~3l . 
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Figure 6. The l-cr uncertainties from o ur analysis (grey/red bars) com- 
pared with those of Chand et al. 1 2004) (black bars). The tight distribu- 
tion of Aa/a values from IChand et alj d2004l) has a probability of just 
Pa = 3 x 10" 4 of occurring by chance given our new robust error esti- 



atively low value even though the algorithm was impaired. When 
subsequently using non-zero values of Aa/a in individual mini- 
mizations, the perturbation which the small shift in a imparts to the 
fit could cause x 2 to preferentially fluctuate to higher values. The 
impaired minimization algorithm may or may not repair this fluc- 
tuation (i.e. reduce x 1 by adjusting the parameters of the fit); this 
'hysteresis' would therefore bias Aa/a towards zero. 



3.4 Likely systematic errors 

Although Fig. [5] demonstrates the robustness of our Aa/a and 
S(Aa/a) estimates, the large scatter of the results in Fig.|4]is incon- 
sistent with our previous HIRES results. Furthermore, the HIRES 
values had a scatter consistent with that expected from the d(Aa/a) 



estimates (e.g. lWebb etalll 1 9991: |M03| ; !mo4 >. What systematic ef- 
fects might contribute to the additional scatter in Fig.[4f 

We conside r ed a wi de va riety of systematic effects on Aa/a 
in Murphy et al.l d2001 bl) and lM03l the most obvious possibility 
being wavelength calibration errors. The quasar spectra are wave- 
length calibrated by comparison with exposures of a thorium-argon 
(ThAr) emission-line lamp. A simple test for miscalibration ef- 
fects was described in Webb et al. (1999) and applied to the HIRES 
data in Murp hy et al] J2001bl) and lM03l : the basic approach was to 
treat the ThAr emission lines near the redshifted quasar absorp- 
tion lines to the same MM analysis, thereby deriving a correction, 
(Aa/o-JxhAr, to the value of Aa/a in each absorber. For the HIRES 
spectra, wavelength calibration errors contributed negligible cor- 
rections, especially since so many absorption systems (128) were 
used dM03l) . 

This ThAr test was not applied to the results of C04. How- 
ever, recently in lMurphv et alj d2007h we found that corruptions of 
the input list of ThAr wavelengths caused significant distortions of 
the wavelength scale in UVES spectra such as those of C04. From 
these distortions it is possi ble to quantify the va lue of (Ao-/a) ThAr 
and it was demonstrated in iMurphv et ail (2007) that the absorber 
at z abs = 1.2433 towards Q0122-380 [Fig.|Hleft)] was, again, par- 
ticularly problematic, having (Ao'/Q') ThAl . = +0.4 x 10~ 5 . This is 
4 times larger than the formal uncertainty quoted by |C04| for this 
system. However, for most absorbers the corrections due to wave- 
length calibration errors are small compared to the scatter in Fig.|4j 
other systematic errors must dominate. 

Another strong possibility is that too few velocity components 
have been fitted to the absorption profiles in many of the 23 ab- 
sorbers. If this is the case then one should expect to find values of 
xl for the profile fits exceeding « 1 , whereas |C04| generally found 
Xy ~ 1 for their fits. Howeve r, as mentioned several times above, 
the error spectra employed by |C04l were set too high by a factor of 
~l.3-2. This is easily cross-checked by comparing the r.m.s. flux 
in continuum regions around the absorption profiles with the l-cr 
error spectra. Thus, when more appropriate error arrays are em- 
ployed, as in our new analysis, the velocity structures of |C04| prove 
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too simplistic, resulting in the high values of xl ~ 1.5-4 we derive. 
Clearly - and, in many cases, this is obvious simply upon visual in- 
spection - more velocity components must be fitted in almost all 23 
absorption systems to account for the evident velocity structure that 
the high^J values reflect. Preliminary fits which include additional 
velocity components indicate that 'under-fitting' of the absorption 
profiles has indeed caused large, spurious excursions in Aa/a and 
may well be responsible for the bulk of the scatter in Fig. [4] The 
following Section presents a discussion and simulations of compli- 
cated velocity structures which confirm this. 



4 OTHER CONSTRAINTS FROM UVES SPECTRA 

As mentioned in Section [T] several other recent studies of UVES 
QSO spectra have ostensibly provided constraints on Aa/a. The 
first of the s e was the AD analysis of 15 Siiv doublets by 
IChand et all J2005h . However, the y 2 curv es they present contain 
strong fluctuations just like those in |C04| - see their figures 1-6. 
It is therefore with caution that their final weighted mean result of 
Aa/a = (+0.15 ± 0.43) x 10~ 5 (1.5 < z abs < 3.0) should be inter- 
preted. Our analysis of a sample of 21 somewhat lower S/N Siiv 
absorbers from Keck/HIRES gave Aa/a = (-0.5 + 1.3) x 10~ 5 over 
the range 2.0 < z abs < 3.1 without similar problems in minimizing 
X~ for each absorber (Murp hy et alj20o"lch . 

In Section [2.2.31 we saw that the MM analysis of the single 
complex z abs = 1.151 absorber towards HE0515-4414 by lLOq 
gave a very small uncertainty of 6{Aa/a) = 0.084 x 10~ 5 but 
that the limiting precision was substantially larger, 6(Aa/a)a m = 
0.14 x 10~ 5 . However, in this case, we cannot easily identify the 
cause of the inconsistency. Nevertheless, it is quite possible, even 
likely, that the cause of the underestimated uncertainty also affected 
the value of Aa/a and, a gain, caution should evidently be used in 
interpreting the result of lLOq . Previous analyses of the same ab- 
sorber by t he same group u tilized very simplistic profile fits: see 
figure 2 of lOuast et alJd2004r) . particularly at velocities around -20, 
15, 40, 50-55, 65, 85 kms~' where large residuals are clearly visi- 
ble. As we demonstrate below, these are very likely to have caused 
large systematic effects in this single-absorber estimate of Aa/a. 

Th e same single absor ber was studied, again with MM anal- 
ysis, bv lChand e t al. (2006). However, in this case the fluctuations 

on the x 2 curve were so large 50; see their figure 9 - that the 

authors found it difficult to define a minimum in the curve. Instead 
they attempted to fit a low-order polynomial through the large fluc- 
tuations - as one would fit a line through noisy data - to define 
a minimum. It must be strongly emphasized that such a practice 
is illogical and yields completely meaningless values of Aa/a and 
6(Aa/a). Firstly, it is not 'noise' in the usual sense that one is at- 
tempting to fit through but spurious fluctuations in x 1 caused by 
the failure of the algorithm to find the true minimum at each fixed 
input value of Aa/a. Secondly, the real x 2 curve must lie beneath 
the majority of points on the^ 2 and it cannot lie above any of them. 
The logical conclusion is that one cannot infer the shape, minimum 
or width - i.e. Aa/a or 5(Aa/a) - from such ax 2 curve since the 
real x 2 curve may lie anywhere below it. 

The most recent constraint on Aa/a from UVES QSO spectra 
was derived from MM analysis of the z abs = 1.839 absorber to- 
wards Q 1101-264 by L07: Aa/a = (+0.54 ± 0.25) x 10~ 5 . Three 
Fe ii transitions were employed - /11608, A23S2 and /12600. The lat- 
ter two have nearly identical ^-coefficients so they shift in concert 
as a varies. However, the bluer line, /11608, shifts in the opposite 
sense to the other two and is therefore crucial for any meaning- 



ful constraint on Aa/a to be derived. It is also the weaker line of 
the trio, with an oscillator strength less than a third of the others. 
As outlined in Section [3~4l systematic effects, even with small sta- 
tistical samples of absorbers, can result if one does not fit the ob- 
served structure in the absorption profiles with an adequate number 
of velocity components. For any analysis of a single absorber, this 
becomes particularly important. 

|L07| explored this effect by using three different fits: a fiducial 
one with 16 velocity components and two others with fewer ( 1 1 and 
10) components. They find very similar values of Aa/a from all fits 
and therefore maintain that Aa/a is insensitive to the number of fit- 
ted components. However, the components removed from the fidu- 
cial fit to form the 11- and 10-component fits appear mainly at the 
edges of the absorption complex and, crucially, do not absorb sta- 
tistically significant fractions of the continuum in the weaker Fe n 
/U608 transition. That is, those components do not appear in Fen 
/11608. Since this transition is vital to provide any sensitivity to a 
at all, one must find similar values of Aa/a in all three fits; as far 
as Aa/a is concerned, the three fits are identical and the test, in 
this case, is ineffective. In any case, visual inspection of the resid- 
uals between the fiducial fit and the data (figure 1 in lL07t) reveals 
correlations over ~20-pixel ranges and, moreover, these ranges oc- 
cur at similar velocities in the three different transitions. This is 
one indication of more than 16 components being required in the 
fit, not fewer. We will present further analysis of this absorber in 
Bainbridge et al. (in preparation). 

To illustrate the effect of 'under-fitting' absorbers in this way, 
Fig. [JJ shows a simulated absorption spectrum generated with 6 
velocity components but which has then been fitted with different 
numbers of components. The Mg n doublet (/1/12796/2803) and the 
five strongest Fen transitions longward of 2340 A were included 
in the fit but Fig. [JJ just shows two representative transitions. All 
transitions were simulated with a S/N of 200 per 2.5-kms~' pixel 
in the continuum. The velocity structure was inspired by (but is not 
strictly the s ame a s) a real absorption system - one of the 23 con- 
tained in the |C04| sample - and includes two weaker components 
(the second and fourth from the left). It is these components which 
are missing in our 4- and 5-component fits to the simulated data. 
These fits result in values of Aa/a which deviate significantly from 
the input value depending on which component is removed. Thus, 
'under-fitting' individual absorption systems can easily cause spu- 
rious values of Aa/a. 

With such high S/N 'data' we can also 'over-fit' the simu- 
lated absorption system. The additional components were placed 
at around -10 and 10-20 kms~'. Of course,^ for these fits is be- 
low unity and, more importantly, the additional components are not 
statistically justified: the reduction in,^ 2 they provide compared to 
the fiducial 6-component fit is smaller than the additional number 
of free parameters they introduce. Nevertheless, the results show 
that the value of Aa/a is robust to the introduction of these com- 
ponents. We hasten to add that one cannot simply keep fitting ad- 
ditional components: note that the uncertainty on Aa/a increases 
as one adds components - with more components, x 2 becomes in- 
creasingly insensitive to Aa/a. However, when reporting strong 
constraints on Aa/a from individual absorbers, some demonstra- 
tion of how robust Aa/a is to both under- and over-fitting is desir- 
able and our illustration in Fig. |7j suggests that the latter is more 
conservative than the former. 
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Figure 7. Fitting a simulated absorption profile with different numbers of velocity components. Left: Two transitions from the simulation showing the 6- 
component profile (green/grey curve) used to generate the synthetic data with S/N = 200 per 2.5-kms~' pixel (black histogram). When under-fitting the data, 
we removed either or both the second and fourth components from the left. When over-fitting we added weak components around -10 and 10-20 km s . 
Right: Values of Aa/a obtained from the^ 2 minimization. For each velocity structure (i.e. each fit with a different number and/or placement of components) 
we plot the mean value of Aa/a and its standard deviation over 1000 realizations of the simulated data (the mean l-cr uncertainty from the realizations was 
also very close to the standard deviation). Note the large scatter in Aa/a when the profile is fitted with fewer components than really present ('under-fitted') 
and the small scatter when it is 'over-fitted' . 



5 CONCLUSION 

We have critically analysed the reliabil ity of the MM treatmen t 
of 23 VLT/UVES absorption systems bv lChand et ail d2004IC04) . 
Using the same data and profile fits we find values of Aa/a i n in- 
dividual absorbers which deviate significantly from those of |C04| 
and our uncertainty estimates are consistently and, in some cases 
dramatically, larger. Indeed, simple (but robust) calculations of the 
limiting preci sion available on Aa/a in these absorbers indicates 
that >half of IC04r s quoted uncertainties are impossibly low; the 
S/N of the spectra and the complexity of the fitted velocity struc- 
tures simply do not allow such small uncertainties on Aa/a. 

This is altogether unsurprising given the large fluctuations in 
the x 2 curves presented by IC04l The only way such large fluctua- 
tions can occur is if the x 2 minimization algorithm fails to reach a 
truly minimum value at each step along the input Aa/a axis. That 
is, since the very means by which Aa/a is estimated (the^ 2 curve) 
is flawed, so are the values of Aa/a and their uncertainties invalid. 
Just as the l-cr errors were underestimated, we have also demon- 
strated that lC04l 's values of Aa/a are strongly biased towards zero. 
Again, this is likely to stem from the fluctuations on the^ 2 curves. 

It is therefore expected that IC04l 's weighted mean result of 
Aa/a = (-0.06 ± 0.06) x 10~ 5 should not truly represent the re- 
duced data and profile fits they employed. Indeed, our own analy- 
sis - again, with the same reduced data and profile fits - yields a 
very different central value and much a larger error bar: Aa/a = 
(-0.44 ± 0.16) x 10~ 5 . Since our^ 2 minimization is demonstrably 
robust, we argue that this latter value does truly reflect the reduced 
data and profile fits. However, we do not argue that this value is 
necessarily the final or best one to be gleaned from this dataset: im- 
provements in the profile fits are almost certainly required to reduce 
the evident scatter in the 23 values of Aa/a to within that expected 
based on their (robust) l-cr uncertainties. Although not discussed 
in this paper, improvements in the data reduction process may also 
be needed. After increasing the uncertainties by adding a constant 
amount in quadrature to match the scatter, we ob tain a more conser- 
vative estimate of the weighted mean from lC04l 's reduced data and 
profile fits: Aa/a = (-0.64 ± 0.36) x 10~ 5 . Note that the uncertainty 



here is 6 times larger than that quoted by |C04l The data and fits of 
C04 thus provide no stringent test of the Keck/HIRES evidence for 
a varying a. 

Jagged x 2 curves have also affected the A D analysis of Si iv 
doublets in UVES spectra bv lChand et"al] d2005l) and the MM anal - 
ysis of a single, high-S/N UVES spectrum by Chand et al. (2006). 
The same single absorber was studied by iLevshakov et all (2006) 
but their quoted uncertainty is much lower than the limiting pre- 
cision available, even in principle, from this spectrum. The only 
other UVES cons traint on Aa/a is from anoth er single absorption 
system studied by Levshak ov et aljj2007llL07h . However, we have 
demonstrated that when analysing individual systems in this way, 
care must be taken to ensure that all the structure in the absorption 
profiles is adequately fitted. Indeed, simulations indicate 'under- 
fitting' the profile can cause dramatic spurious excursions from the 
real value of Aa/a whereas 'over-fitting' the profile (to a mild de- 
gree) is a more conservative approach. We argue that a dditional 
components are probably required to fit the data of lL07l : this will 
be demonstrated in Bainbridge et al. (in preparation). 

In summary, reliable comparison of HIRES and UVES con- 
straints on a varying a must await improvements in the analysis of 
UVES spectra. We are currently reducing >100 UVES spectra to 
arrive at an internally and statistically robust estimate of Aa/a for 
this purpose. 
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